Job Radar. Live notifications. AI processed.
freelancer.com 2026-04-20 π’
πΉ Robust Web Scraping for Product Data Extraction
π€ Client: πΊπΈ Senbillawain, United States Member since 2022-02-10
π° Price: $415 Average bid
π© Problem: Extract accurate and complete product data from G2A to complement the existing API integration in a Laravel-based platform.
π¦ Existing: Integration with G2A API, Laravel backend
Specifications:
[Target] Extract full categories structure, product descriptions, alerts, and activation guides for 240K+ products.
[Method] Use Python (FastAPI preferred) with headless browsers like Playwright to handle dynamic content and anti-bot protections.
[UI/UX] Not applicable
[Stack] Python, FastAPI, Playwright, Laravel, VPS
[Security] Strong error handling, retry logic, logging, no impact on main Laravel app
[Format] JSON for structured data output
Workflow:
Set up headless browser environment with Playwright.
Define scraping rules and selectors to extract categories, product descriptions, alerts, and activation guides.
Implement parallel execution strategy using queues and workers.
Integrate scraped data with existing API data based on product ID and slug.
Test initial 50 products for accuracy, category mapping, alert box extraction, and activation guide.